Markov Processes and Their Applications
نویسندگان
چکیده
منابع مشابه
Generating function zeros of Markov processes and their applications
of the Dissertation Generating function zeros of Markov processes and their applications
متن کاملFixed Point Results and Their Applications to Markov Processes
A. Tarski proved in his fundamental paper [18] that the set Fix(G) of fixed points of any increasing self-mappingG of a complete lattice is also a complete lattice. Davis completed this work by showing in [3] that a lattice is complete if each of its increasing self-mappings has a fixed point. As a generalization of this result Markowsky proved in [16] that each self-mapping G of a partially or...
متن کاملSemi-markov Decision Processes and Their Applications in Replacement Models
We consider the problem of minimizing the long-run average expected cost per unit time in a semiMarkov decision process with arbitrary state and action space. Using the idea of successive approximations, sufficient conditions for the existence of an optimal stationary policy are given. These results are applied to solve the replacement problem with a semi-Markov shock model.
متن کاملBivariate Markov Processes and Their Estimation
A bivariate Markov process comprises a pair of random processes which are jointly Markov. One of the two processes in that pair is observable while the other plays the role of an underlying process. We are interested in three classes of bivariate Markov processes. In the first and major class of interest, the underlying and observable processes are continuous-time with finite alphabet; in the s...
متن کاملCascade Markov Decision Processes: Theory and Applications
This paper considers the optimal control of time varying continuous time Markov chains whose transition rates are themselves Markov processes. In one set of problems the solution of an ordinary differential equation is shown to determine the optimal performance and feedback controls, while some other cases are shown to lead to singular optimal control problems which are more difficult to solve....
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Nature
سال: 1962
ISSN: 0028-0836,1476-4687
DOI: 10.1038/194515a0